Each Reader Decides if a Replication Failing the Small Telescopes Test Counts; Reply to Schwarz and Clore (2016 .pdf)
نویسنده
چکیده
I agree with Schwarz & Clore (.pdf) on the importance of considering differences between original and replication studies when interpreting replication failures. I disagree on the proposition that without manipulation checks replications cannot be statistically analyzed as such, and disagree on their approach to considering hypotheses for why a replication failed. They stop after generating hypotheses, I show the benefits of also testing them. I propose a heuristic for deciding which design differences replicators should highlight in their articles. A unifying theme is that replicators are communicating with all readers, not just the original authors; the goal is informing the former rather than persuading the latter.
منابع مشابه
Evaluating Psychological Research Requires More Than Attention to the N.
Simonsohn (2015) proposed to use effect sizes of high powered replications to evaluate whether lower powered original studies could have obtained the reported effect. His focus on sample size misses that effect size comparisons are informative with regard to a theoretical question only when the replications (i) successfully realize the theoretical variable of interest, which (ii) usually requir...
متن کاملExtract Me If You Can: Abusing PDF Parsers in Malware Detectors
Owing to the popularity of the PDF format and the continued exploitation of Adobe Reader, the detection of malicious PDFs remains a concern. All existing detection techniques rely on the PDF parser to a certain extent, while the complexity of the PDF format leaves an abundant space for parser confusion. To quantify the difference between these parsers and Adobe Reader, we create a reference Jav...
متن کاملThe Lexicon and Grammar of Affect as Information in Consumer Decision Making The CAlM
As epitomized by Blaise Pascal's famous quote, "The heart has its reason of which reason knows nothing," emotions have historically been conceived as psychobiological forces that energize and channel people's behavior, sometimes at the expense of their better judgment. In advancing the "affect-asinformation" hypothesis that moods, feelings, and emotions serve as sources of information, Schwarz ...
متن کاملDeciding Graph non-Hamiltonicity via a Closure Algorithm
We present a matching and LP based heuristic algorithm that decides graph non-Hamiltonicity. Each of the n! Hamilton cycles in a complete directed graph on n + 1 vertices corresponds with each of the n! n-permutation matrices P, such that pu,i = 1 if and only if the ith arc in a cycle enters vertex u, starting and ending at vertex n + 1. A graph instance (G) is initially coded as exclusion set ...
متن کاملComparison of Small Area Estimation Methods for Estimating Unemployment Rate
Extended Abstract. In recent years, needs for small area estimations have been greatly increased for large surveys particularly household surveys in Sta­ tistical Centre of Iran (SCI), because of the costs and respondent burden. The lack of suitable auxiliary variables between two decennial housing and popula­ tion census is a challenge for SCI in using these methods. In general, the...
متن کامل